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Abstract 


Reliability-confidence combinations for small-sample, no-fail tests of aerospace 
ordnance items are considered in some detail. Analyses epitomized by the widely 
used, but sometimes misapplied, equation 

y - 1 - R n 

are shown to provide unexpectedly good approximations. Component reliabilities 
corresponding to confidences of the order of 70%, as based on tests by attributes, 
are shown to be satisfactory for calculation of simple series and parallel system 
reliabilities; it is suggested that 70% confidence levels may also be a good choice 
for tests by variables. 
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Reliability-Confidence Combinations for Small-Sample 
Tests of Aerospace Ordnance Items 


I. Introduction 

For a complex aerospace system to have even a 50% 
chance of performing its intended function, the chances 
of failure in any one critical subsystem component must 
be extremely low. 

In the evaluation of the reliability of aerospace ord- 
nance components, it is common to find that 

(1) The items are expensive, limiting the number of 
samples available. 

(2) The items are of a special design, with no history 
to suggest their reliability. 

(3) Because the target reliability approaches unity, 
evaluation should be directed at fail rates rather 
than reliability. 1 

(4) The items to be tested are “single-shot” and, unlike 
solenoid relays for example, cannot be operated 
nondestructive^; items operated in test cannot be 
used in flight. 


1 A decrease of less than 1% in reliability, from 99.9% to 99%, would 

represent a tenfold increase in fail rate (i.e., from 34ooo to %oo) • 


(5) Tests by both attributes and variables may be 
appropriate, but the frequency distribution for tests 
by variables is unknown. 2 

(6) There is some uncertainty (if not confusion) in the 
selection of a reliability-confidence combination 
that best expresses the results of the evaluation, 

Today, evaluation of small-sample aerospace ordnance 
tests follows along lines developed in the 1920s by 
Western Electric and Bell Telephone engineers 3 as char- 
acterized by the equation 

j=F j-F 

/)B ' i = 2 ( l) (1 ~ R)i R<n ~ l) = (1 ~ v) 

(1) 

2 Log-normal or comparable distributions are often assumed simply 
as a convenient economy. Although actual test results involving 
only small samples may prove to be consistent with some arbitrary 
distribution, use of such a preselected distribution for extrapolation 
to extreme percentiles may be grossly misleading. 

3 Dodge, H. F., and Romig, H. G., Sampling Inspection Tables , 
Single and Double Sampling , Second Edition, p. 1. John Wiley & 
Sons, Inc., New York, 1959. 
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where 

n = number of pass/fail tests 
F = number of fails detected 
( n\ = 

\ / ) (» -/)! /! 

R = assumed reliability 

/ = assumed fail rate 

y = lower confidence limit on R 
(or upper confidence limit on f) 

Equation (1) reduces, for a series of n tests with no 
failures, 4 to 

(1 ” f) n — R n “1 y (2) 

Both equations allow the results of any particular test 
program to be expressed as indicating any of an infinite 
number of reliability-confidence combinations. For ex- 
ample, a five-sample, no-fail test could be interpreted as 
indicating any one of as many combinations as one wished, 
including those shown in Table 1, as calculated from 
Eq. (2). 


Table 1 . Some reliability-confidence combinations 
for a five-sample, no-fail test a 


Reliability ft, % 

Confidence 7, % 

Maximum fail rate f,% 

99 

5 

1 

90 

41 

10 

87 

50 

13 

80 

67 

20 

70 

83 

30 

60 

92 

40 

50 

97 

50 

40 

99 

60 

“Note the rapid rise in confidence for a decrease 

in reliability from 99% to 

90%. It may be shown that, for f~0, iog 20 {1 — Y) 

~ -0.434 nf . 


The question naturally arises as to which combination, 
if any, is the most descriptive. For example, if the five- 
sample test were used to judge the quality of a further six 
items drawn from the same lot, would the 80% reliability- 
67 % confidence combination imply that, of the six samples, 
at least five (80% ), or four (67%), or three (80% of 67% ), 


Tor simplicity, subsequent^ discussion is limited to no-fail tests; 
these are of particular interest in aerospace ordnance because the 
number of samples available for test is usually so small that even 
one failure may imply an intolerably high fail rate. 


should be expected to pass, or should none be expected 
to pass because none are 100% reliable? 5 

Before proceeding, it is important to note the original 
problem faced by the Western Electric and Bell Tele- 
phone engineers was how to use small samples to deter- 
mine whether a particular incoming shipment of 
components met a quality level which prior shipments 
had shown to be practical. If earlier shipments had ex- 
hibited a reliability of 98 % or better, with an occasional 
bad lot having a reliability as low, for example, as 80%, 
the customer might be content with a small-sample 
receiving inspection scheme that gave him a good chance 
of detecting lots with a reliability of less than 98% . By 
comparison, many aerospace ordnance items involve short- 
run, one-time production offering no prior history on 
which to base an expected reliability; this raises the 
further question of whether Eq. (2) is grossly inappro- 
priate in such cases. 

II, Inherent Reliability of ‘No-History’ Lots 

At first glance, it might seem that evaluation of a lot for 
which all fail rates between 0% and 100% were equally 
likely would be a much more pessimistic process than 
evaluation of a lot for which fail rates below, say, 70% 
were assumed to be somewhat unlikely. This is not so, 
however, because small-sample, no-fail tests quickly cull 
(or ‘screen”) high fail-rate lots (see Appendix B). 

If an n-sample test is made on a large number K of lots 
of size L for which all proportions p of passes P between 
0 and 1 are equally likely, the chances C of any lot yield- 
ing a sample of n Fs is given by 6 

C - p n (3) 

and the number of lots M that will yield such samples 
is given by 



3 Although Eqs. (1) and (2 ) relate to tests by attributes, reliability- 
confidence combinations are also used to express the outcome of 
tests by variables, giving rise to the same question. 

'Equation (3) is true only if samples are returned to the lot as 
drawn, or if the sample size n is so small by comparison with the 
lot size L that the removal of the sample has no significant effect 
on the proportion p of P’s remaining. 
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from which 


M = 


K 

n + 1 


(4) 


The proportion R L of P’s in these M lots representing 
their average quality or “inherent reliability” is given by 


Ri = 1 IlJ 0 KLpn p dp 


1 

ML n + 2 


n + 1 
n + 2 


(5) 


and the proportion y of the M lots that will have at least 
any proportion R of P’s is given by 


Table 2. Approximate chances of various fail rates 
for a lot yielding no fails in eight samples 


Reliability 

** 

Confidence 

7 b 

Most likely 
maximum 
fail rate 
(1 - *) 

Approximate chances of 
indicated fail rate 0 

1 

0 

0 

0 

0.9 

0.613 

0.1 

(0.613-0) = 0.61 

0.8 

0.864 

0.2 

(0.864-0.613) = 0.25 

0.7 

0.959 

0.3 

(0.959-0.864) = 0.1 0 

0.6 

0.9897 

0.4 

(0.9897-0.959) = 0.03 

0.5 

0.9980 

0.5 

(0.9980-0.9897) = 0.008 

0.4 

0.9997 

0.6 

(0.9997-0.9980) = 0.002 

a The inherent reliability of Eq. (5) is 0.9. 
b Calculated from Eq. (6). 


1 c These chances relate strictly to ranges of fail rates, but are more easily visu- 1 

aiized as relating to fails in 

a lot of size 1 0. 


y = (n + 1) J p n dp 

from which 

y — 1 — R n+1 (6) 

Note the similarity between Eq. (2) and Eq. (6). Equa- 
tion (6) shows that an isolated lot yielding no fails in a 
sample of size n will have (with confidence y) a compara- 
tively high reliability even if, prior to sampling, all relia- 
bilities between 0 and 1 were considered equally likely. It 
can be shown that although the inherent reliability ap- 
proaches 1 as n approaches oo, the corresponding y con- 
verges on only 1 — e~ 100 ( — 63.22%). 

Although Eq. (2) would not be strictly applicable to 
the case under consideration, its misuse would still give 
a good approximation, i.e., 

y = 1 - R n+1 ** 1 - R n 


From Table 2, an expectation that the fail rate would 
be 1/10 or less would result in a 25% chance of being 
disappointed by a factor of 2, and a 10% chance of being 
disappointed by a factor of 3. In a manufacturing process 
(such as assembly of radio receivers), inadvertent ac- 
ceptance of one lot in four of components (such as capaci- 
tors) with a fail rate twice "normal,” or of one lot in ten 
with a fail rate three times "normal,” might be coun- 
tered by replacement of faulty items when the assembly 
failed to meet final tests: low confidence in component 
reliability might not necessarily be reflected in the re- 
liability of the manufactured system, but would almost 
certainly be reflected in the cost of "rework” during 
manufacture. In such a case, the selection of the optimum 
reliability-confidence combination would involve trade- 
offs between the costs of additional acceptance testing, 
on the one hand, with the costs of rework, on the other. 

In aerospace ordnance systems, however, faulty sub- 
components may not be detectable by "final inspection” 
of a system, and low confidence in component reliability 
may consequently manifest itself in low system reliability. 


111. Confidence and Unexpected Fail Rates 

Although a proportion y .= 1 — R n+1 of lots yielding 
no fails in samples of size n will contain a proportion 
(1 — R) — l/(n 4- 2) or less of faulty items, the remain- 
ing fraction R n+1 of the lots will contain a proportion of 
faulty items larger than l/(n + 2); from these lots will 
come fail rates which may be unexpected and possibly 
disappointing. For example, from an eight-sample, no-fail 
draw, the probability of various fail rates can be illus- 
trated as in Table 2. 


IV. Reliability-Confidence Combinations 

For a simple series system (such as a chain of links) 
where N components each of pass rate p are used, the 
system reliability R 8 is a probability given by 

R* = P N (7) 

Similarly, for a simple parallel system (such as a raft 
made from oil drums) where N components of pass rate p 
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are used and inclusion of one faulty item is* tolerable, the 
system reliability R p is a probability given by 

R p — p NJ t N*- 1 (1 - p) 

= N»- 1 -(N -l)p N (8) 

When the reliability R but not the true pass rate p of 
components in series or parallel systems is known, it is 
common practice to substitute R for p in equations such 
as Eqs. (7) and (8), often using component reliabilities 
calculated to an arbitrary confidence. For any given sys- 
tem, the system reliability so calculated will obviously 
depend on the confidence associated with the component 
reliabilities; it is system reliabilities qualified by confi- 
dence that are often difficult to interpret. 


In Appendix A, it is also shown that R corresponding 
to a confidence of about 63.2% can provide a useful 
approximation if substituted in Eq. (11), and that R cor- 
responding to a confidence of about 75.7% can provide 
a useful approximation if substituted in Eq. (12). How- 
ever, the component might be used in either a series or a 
parallel system; Table 3 illustrates that use of reliabilities 
calculated to a 70% confidence level (as a compromise 
between 63.2% and 75.7%) provides reasonable approxi- 
mations not only for series systems, but also for parallel 
systems, at least over a wide range of practical situations. 
This table relates to tests by attributes; although the 
comparable situation for tests by variables has not been 
explored, it seems likely that component reliabilities ex- 
pressed at a 70% confidence level as the result of tests 
by variables might also compound to yield fair approxi- 
mations for certain series and parallel systems. 


Although small-sample tests do not allow determina- 
tion of the true pass rate p> in Appendix A it is shown 
that a no-fail test of n samples allows calculation of the 
system reliabilities of Eqs. (7) and (8) as follows: 


Rs 


n + 1 

N + n + 1 


(9) 


, _ n + 1 2 N + n 

:p ~ N + n X N + n + l 


( 10 ) 


Even though no-fail tests by attributes thus allow calcu- 
lation of the probability of success of a system without 
expressing the quality of the components in the form of 
a reliability-confidence combination, it may nevertheless 
be of interest to consider the practicality of substituting 
some such reliability for p in Eqs. (7) and (8) to yield 
useful approximations for R s and R p as calculated by 
Eqs. (9) and (10). In essence, the problem is to find some 
value of R which will satisfy the relationships 


R S = R N = 


n + 1 
N + n + 1 


(id 


On the other hand, Table 3 shows that system relia- 
bilities calculated from component reliabilities based on 
small-sample tests are, at best, only approximations; if the 
true (most likely) pass rate of a system can be calculated 
from no-fail tests by attributes, why then resort to ex- 
pressing component reliabilities at some arbitrary confi- 
dence level? The answer to this question lies in the 
following: 

(1) All calculated pass rates are subject to error arising 
from the assumed distribution. The equations of 
this report are based on the assumption that the lot 
selected for sampling and use is one of an infinite 
number of lots for which all fail rates are equally 
likely; if another distribution prevailed, the dis- 
crepancies of Table 3 might prove relatively in- 
significant. 

(2) The results of small-sample tests by variables are 
probably most easily expressed in terms of relia- 
bility demonstrated at a particular confidence level; 
while this situation prevails it seems undesirable 
to use a different form of expression for tests by 
attributes. 


R p = NR N - l - (N - 1 )R" = £4 1 
p v 7 N + n 


2 N + n 
N + n + 1 


( 12 ) 


Any such value of R should be substantially independent 
of N to cover the common situation in which the nature 
of the system is unknown by those conducting the small- 
sample test. 


V. Compounding Subsystem Reliabilities 

It has been shown that, under certain circumstances, 
the reliability of a system can be expressed as (or approxi- 
mated by) a true pass rate; if such a system is a (series) 
subsystem in a larger system for which no subsystem 
failures are tolerable, the reliability (or pass rate) of the 
whole system R t will be the product of the reliabilities 
(pass rates) of the various subsystems R. In the simple 
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Table 3. Effect of using component reliabilities corresponding to y = 70% for calculation of reliability 
of systems compounded of items drawn from the one lot a 


Number 

of 

samples 

in 

no-faif 

test 

(n) 

Reliability R 
at 70 % 
confidence, 

= (1 — 0.70) 1/111 +1 * 
= Q.3QVt«+i) 

Series systems, N comp 
tolerable 

True system pass rate: 
Pass rate: fi(R) = 

>onents, no faulty con 

rt n+1 

iponents 


Parallel systems, H compo 
one faulty component t 

True system pass rate: R p 

Pot* rate: f 2 («) = HkF~ 1 

nents, not more than 
ftlerable 

" + ! v 2N + n 

" 8 N + n + 1 

N+n ' ' N+n+ 1 
- (N- 1)*^ 

N = 

= 2 

N 

= 10 

N — 

100 

N = 

2 

N = 

100 

ID 

am 


1 - h {« 

m 

1 - h (*) 

1 -* p 

1 - h («) 

1 - K p 

am 

2 

0.669 

0.40 

0.55 





0.100 

0.109 



3 

0.740 

0.33 

0.45 





0.067 

0.068 

0.49 

0.78 

4 

0.786 

0.29 

0.38 





0.048 

0.046 

0.43 

0.66 

8 

0.875 

0.18 

0.23 





0.018 

0.01 6 

0.26 

0.36 

10 

0.896 

0.15 

0.20 

0.48 

0.67 



0.013 

0.01 1 

0.21 

0.28 

20 

0.9443 

0.087 

0.108 

0.32 

0.44 



0.0040 

0.0031 

0.097 

0.104 

40 

0.971 1 

0.047 

0.057 

0.20 

0.25 



0.0011 

0.00084 

0.035 

0.032 

80 

0.9852 

0.024 

0.029 

0.1 1 

0.14 



0.00029 

0.00022 

0.01 1 

0.0091 

100 

0.9882 

0.01 9 

0.024 

0.090 

0.112 

0.50 

0.70 

0.00019 

0.00014 

0.0074 

0.0059 

200 

0.9940 

0.0099 

0.012 

0.047 

0.058 

0.33 

0.45 

0.000049 

0.000036 

0.0020 

0.0016 

400 

0.9970 

0.0050 

0.0060 

0.024 

0.030 

0.20 

0.26 



0.00053 

0.00040 

1000 

0.99880 

0.0020 

0.0024 

0.0099 

0.012 

0.091 

0.11 



0.000088 

0.000065 

2000 

0.99940 

0.0010 

0.001 2 

0.0050 

0.0060 

0.048 

0.058 





4000 | 

0.99970 

0.00050 

0.00060 

0.0025 

0.0030 

0.024 

0.030 | 





10000 

0.99988 

0.00020 

0.00024 

0.0010 

0.001 2 

0.0099 

0.012 






“Calculated failure rates (1 — R), rather than calculated reliabilities (R) have been tabulated for ease of comparison. Thus, from the table, for a series system of 10 units com- 

( {0.44-0.321 \ 
i«e., — q ^ J 

higher than the likely (true) fail rate. 


case where n subsystems of equal reliability R are in- 
volved, 

Rt = R n 

Although R t and R are both pure pass rates without a 
qualifying confidence level, the qualities of both the 
system and subsystems are possibly easier to understand 
as confidences (in 100% reliability) than as reliabilities 
(at 100% confidence). 

VI. Tests by Attributes vs Tests by Variables 

Present-day qualification tests for aerospace ordnance 
items are, more often than not, based on tests by at- 
tributes — a carry-over from typical qualification tests for 
military ordnance items. Unlike aerospace ordnance items, 
many military items involve long production runs with 
fixed tooling, are not likely to be used as critical elements 
in a complex and expensive system, and can be recalled 
if intolerable failure rates are detected in service; al- 
though qualification to a reliability of possibly 95% might 
be acceptable for a military cartridge, the different cir- 


cumstances might make qualification to a reliability of 
99.9% more appropriate for the aerospace counterpart of 
this same cartridge. 

Qualification by attribute-testing to a 99.9% reliability 
requirement (at a 70% confidence level) would call for 
a minimum of about 1200 samples for each type of 
destructive test — -a quantity which would be economically 
prohibitive in many cases. 

Provided one is prepared to assume an arbitrary dis- 
tribution (such as the log-normal) and can devise appro- 
priate tests, qualification by use of tests by variables 
may, by contrast, allow use of a practical minimum of 
only about six samples. 

Although use of tests by variables is consequently 
attractive (if not unavoidable) for qualification of aero- 
space ordnance items, until the problem of reliability- 
confidence combinations for such tests has been solved, 
the only practical course seems to be to adopt the 70% 
confidence level which appears appropriate for tests by 
attributes. 
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VII. Conclusions 

If, prior to testing, it is agreed that the lot of items is 
one of many for which all fail rates between 0 and 1 are 
equally likely 

(1) Analysis of test results by methods epitomized by 
the equation 

y = 1 - R n 

can continue to be used without introducing serious 
errors. 

(2) Samples of size n that yield no failures belong to 
families of lots having an inherent reliability 


with a confidence y = 1 — R n+1 . 

(3) The true pass rate of a simple series or parallel 
system or subsystem can be calculated on the basis 


of the results of no-fail tests by attributes, without 
reference to a confidence, but is possibly easiest 
understood if described as a confidence (in 100% 
reliability). 

(4) Component reliabilities expressed at a 70% confi- 
dence level as the result of no-fail tests by attributes 
may be compounded to yield fair approximations 
to pass rates for simple series and parallel systems, 
at least over a wide range of practical situations. It 
seems reasonable to assume that the results of tests 
by variables expressed as reliabilities at a confi- 
dence of 70% could also be compounded to yield 
fair approximations to the pass rates of such systems. 

(5) Although confidence levels of about 70% appear 
appropriate in calculation of system or subsystem 
reliabilities, higher or lower confidence levels may 
be more appropriate from some economic stand- 
point. 
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Appendix A 

Reliability of Simple Series and Parallel Systems Based on a No-Fail Small-Sample 
Test of the Lot From Which the Components Are Drawn 


Let 

R 8 = reliability of a simple series system (e.g., a 
chain of links) in which no faulty components 
are tolerable 

R p — reliability of a simple parallel system (e.g., a 
raft of empty oil drums) in which not more 
than one faulty component is tolerable 

n = number of samples (chain links or oil drums) 
in a no-fail test of the lot from which the sys- 
tem is compounded 

N — number of components in the system 

p = true pass rate of the components 

Ri — inherent reliability of the components (« + 1)/ 
(n 4- 2) 

■y — 1 — R n+1 = Confidence in component relia- 
bility R 

Assume that, prior to sampling, the lot of components 
from which the system is to be compounded is one of a 
large number of lots for which all pass rates p between 
zero and one are equally likely. 

I. Series Systems 

The proportion of lots which will yield n good samples 
in an n-sample test == l/(n + 1), and of lots which will 
yield n + N good samples in an (n + N) draw = 
1/(N + n+1) (see Eq. 4). 

The chances of getting N good samples in an N-sample 
draw after having previously drawn no fails in an n-sample 
draw is, consequently, given by 

n+1 
N + n + 1 

• R = U + 1 

• N + n + 1 


But 


R s = V* 


( n + 1 N 


L * '■ 

ii/y 

J N « n 

p ~ \N + n + 1 / 

) 

n + 1 

t 

~1 1 

n + 1 


n » 1 

~ 1 n + 1 ~ 

' n + 2 



p « Ri 

Thus, for series systems in which N » n and n » 1, the 
inherent reliability of components may be used as a true 
(unqualified) pass rate for calculation of the reliability 
of the system; alternatively, because the confidence for 
inherent reliability converges on 63.2%, 7 the reliability 
corresponding to a confidence of 63.2% could be used as 
the true pass rate. 

II. Parallel Systems 

The fraction of lots which will yield n good samples in 
n is given by 

1 1 

p n dp = n ~ y = ( see Eq* 4) 

The fraction of lots which will yield no failures in a 
sample of size (N + n)is similarly given by 1/(N+ n+1) ~F 2 


7 Even for small values of n, the reliability at a confidence of 63.2% 
does not differ markedly from the inherent reliability, nor does the 
confidence in inherent reliability differ markedly from 63.2% . These 
points are shown by the following: 


n 

2 

4 

7 

15 

80 

D _ n + 1 
R ‘ n + 2 

0.75 

0.833 

0.889 

0.941 

0.988 

R for 63.2% 
confidence, 

= ( i-o.es2) ,/, ‘ t1 ’ 

0.717 

0.819 

0.883 

0.939 

0.988 

Confidence in 
inherent reliability, 

1 r» n+1 

7 = 1 -Ri 

0.58 

0.60 

0.61 

0.62 

0.63 
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and the fraction of lots which will yield noipore than one 
failure is given by 

[p(w+n) -f (J$ + (1 — p)] dp 

1 [(N + n)p {N+n ~ 1) - (N + n + l)p<* +n > ] dp 
N + n+ 1 2 3 

Thus, a fraction F 3 — F 2 — 1/(N + n +1) = F 4 of lots 
will yield one failure in (N + n) samples, and of this frac- 
tion a proportion N/(ZV + n) = F 5 involves no failures in 
the first n samples. 



Now 


y — 1 — Rn + 1 

and for 


R — p 

y = 1 - p w+1 = 1 - (1 - 

j r, / 2 


[ / 2 \ VSs -| n + 1 

y (N + n) (N + n + 1) J J 

= ( n + ^ [(N + n)(N + n + 1) J 


(n + 1) (n) 
2 ! 


The proportion of lots R v which, having yielded n no- 
fail samples, will then yield no more than one failure in 
the next N samples is, therefore, given by 

„ _ f 2 + f 5 X f 4 


1 | N 1 

N + n + 1 N + n N + n + 1 
1 

n + 1 

n + 1 v 2 N + n 

WTn N + n 1 1 


But 


R P = P N + N/- 1 (1 - p) 

= N /- 1 - (N - l)p» 

= N(1 - ff- 1 - (N - 1) (1 - if f = 1 - p 

- 1 ) 


= 1 - 


2! 


-f 


1 


n + 1 2N + n 
X 


N + n N + n + 1 


2 "l** 

' • * = _(N + n)(N + n+ i)j 1 


x ;wW (N+n+1) 


+ ••• 


Which, for n»N 


21/2 _ 


2 ! 




2 3/2 

bT 


i.e., 


P-V2" : 


4.113 


75.7% 


Thus, for parallel systems in which one faulty compo- 
nent is tolerable and the number of components N is small 
by comparison with the size n of a no-fail sample (thus 
meeting the requirements that n»N and Nf « 1), the com- 
ponent reliability corresponding to a confidence of 75.7 % 
could be used as a true (unqualified) pass rate for calcu- 
lation of the reliability of the system. 

The degree of approximation involved in using compo- 
nent reliability corresponding to a 70% confidence (as a 
compromise between the 63.2% appropriate for series 
systems and the 75.7% appropriate for parallel systems) 
is shown in Table 3. 
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Appendix B 

Sifting Effect of Small Sample No-Fail Tests 


No-fail tests of n samples can be thought of as a sieve, 
separating the better lots from the poorer lots. Suppose 
the lots come in boxes of 100 parts per box, and that a 
warehouse contains 101 million boxes. Suppose further, 
that all pass rates are equally likely. Then, there are a 
million boxes containing no good parts, a million with one, 
a million with 2, . . . , a million with 99 good parts, and 
a million boxes with all 100 parts good. If we knew how 
many good parts were in each box, we could stack all 
those with each number of good parts in a separate pile. 
If these piles were arranged in order of the number of 
good parts, the tops of the piles would look like the upper 
line (n = 0) in Fig. B-l. 

Suppose that one part is taken out of each box and 
tested. Some of the tests will reveal defective parts. When 
this happens, we will remove that box from the stack. 
The probability that we will not remove a box from its 
pile, when all the boxes in that pile have p good parts 
(and 100 — p defective parts), is simply p/100. Since there 
were a million boxes in the pile there will now be 
(p/100) X 10 6 boxes left. The tops of the piles would look 
like the line marked n == 1 in Fig. B-l. 

Similarly, if we take a second sample from each box, 
and again throw out the boxes that yielded a defective 
sample, the tops of the piles would look like the line 
marked n = 2. There were (p/100) X 10 6 boxes in the 
pth pile. Only p/100 (approximately) of these boxes 
passed the second test, leaving (p/100) 2 X 10 6 boxes in 
the pth pile. Figure B-l shows the appearance of the top 
of the stack after several siftings. The number of boxes 
left in the pth pile, after any box yielding a defective 
sample in n samples has been discarded, is (p/100) w X 10 6 . 

What has all this to do with reliability and confidence? 
The sorting in the previous paragraphs can only be done 
conceptually, of course, since the number of good parts 
in each lot (box) is not known to us. Consequently, accept- 
ing a lot after it passes an n-sample no-fail test is like 
taking all the piles that are left, mixing up the boxes, and 
drawing one at random. How many good parts does it 
contain? What is the chance that a system composed of 
parts from this box will work? 

The probability that a part taken from any particular 
box will work is simply the number of good parts in that 


box, p, divided by 100. But, by definition, this is the 
reliability of the parts in that box. On drawing a box, 
however, we do not know what this reliability is. We do 
know how many boxes there were with each reliability. 
Consequently, we can state a probability that the reliabil- 
ity of the drawn box is at least R, for any value of R 
between 0 and 1. Again, we note that this probability is, 
by definition, the confidence, y, that the reliability is R. 
The relationship between reliability and confidence re- 
sulting from an n-sample, no-fail sifting sequence applied 
to an initial lot distribution in which all pass rates were 
equally likely (usually a conservative assumption) can be 
easily expressed by dividing the number of boxes with 
an equal or higher reliability than R by the total number 
of boxes left. Thus, 

f 1 (p/100) n X 10 6 dp 

— — = J _ Rn + i 

1 (p/100) w X 10 6 dp 

The quantity which we have called inherent reliability is 
the total fraction of good parts in the boxes remaining. 
Since there are p good parts in each box in the pth pile, 
we have 



Ri 


r 


(p/100)” X 10 6 X pdp 


jf 1 (p/100)" X 10 6 dp 


n + 1 
n + 2 


Components, however, are only of interest because we 
wish to combine them to make systems. Immediately, 
we are faced with finding those (y, R) pairs which should 
be chosen to give specified system pass rates. If we con- 
tinue with the assumption that the n-sample, no-fail test 
has been used to preferentially sift an initial population 
in which all pass rates were equally likely, we seek that 
confidence level, y, whose associated reliability, R r , will 
give the same average system pass rate as if R r were the 
true reliability of the lot used. 

It was shown in Appendix A that the result of this quest 
depends on the logical connection of components in the 
particular system being studied, but that the appropriate 
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NUMBER OF BOXES IN EACH PILE AFTER DISCARDING ANY BOX 
YIELDING ANY DEFECTIVE SAMPLES IN n TESTS 



Fig. B-l . Number of lots of each reliability after n no-fail tests 
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confidence level ranges from 63% to 76%. The sugges- 
tion was made in Section V that component reliabilities 
corresponding to a confidence level of 70% may give a 
satisfactory approximation for most uses. 

We have seen in Fig. B-l that low pass rates are indeed 
rapidly screened out by the small sample no-fail tests. 
Suppose, however, we are concerned with an application 
in which we would consider a 99% reliability to be low. 
Are small sample no-fail tests still useful? By considering 
the fact that 98 samples must be drawn to raise the inher- 


ent reliability to 99%, we see that large samples (i.e., at 
least 98) will be required. 

To fully answer this question, consider Fig. B-2, which 
shows the sifting effect on lots of high-reliability compo- 
nents. This figure shows that relatively large samples 
must still be tested to obtain an appreciable sifting effect 
even if only lots with pass rates exceeding 99% were 
initially present. The implication is that testing by attri- 
butes (go, no-go) is not efficient for demonstration or 
determination of high reliabilities. 



Fig. B-2. Sifting effect on high-reliability lots 
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